A Fractional Differencing Method for File System Data Storage and Transmission
نویسنده
چکیده
We introduce a method for computing the difference between a pattern string (data block or file) and a much larger, iteratively updated set of strings (an entire file system or cache thereof), while only examining a small fraction of this set. We show how our method generalizes existing algorithms used in a unique block storage system (venti), and a low bandwidth network file system (LBFS), and a differencing incremental backup system (by Burns & Long). We also provide improved algorithms for all these systems, and introduce a new file system (wonkyfs) that can offer better compression than building on top of an improved block systemi. Finally, we combine the compression and bandwidth reduction improvements in the case of a versioning client-server wide area file
منابع مشابه
Engineering a Differencing and Compression Data Format
Compression and differencing techniques can greatly improve storage and transmission of files and file versions. Since files are often transported across machines with distinct architectures and performance characteristics, compressed data should be encoded in a form that is portable and efficient to decode. This paper describes the Vcdiff encoding format for differencing and compression data a...
متن کاملFractional Fourier Transform Based OFDMA for Doubly Dispersive Channels
The performance of Orthogonal Frequency Division Multiple Access (OFDMA) system degrades significantly in doubly dispersive channels. This is due to the fact that exponential sub-carriers do not match the singular functions of this type of channels. To solve this problem, we develop a system whose sub-carriers are chirp functions. This is equivalent to exploiting Fractional Fourier Transform (F...
متن کاملAn Efficient Data Replication Strategy in Large-Scale Data Grid Environments Based on Availability and Popularity
The data grid technology, which uses the scale of the Internet to solve storage limitation for the huge amount of data, has become one of the hot research topics. Recently, data replication strategies have been widely employed in distributed environment to copy frequently accessed data in suitable sites. The primary purposes are shortening distance of file transmission and achieving files from ...
متن کاملAn Efficient Versioning File System for Self-Securing Storage
Self-securing storage prevents intruders from undetectably tampering with or permanently deleting stored data. By keeping all versions of all data for a window of time and separating the storage system from the host operating system, self securing storage can protect its data from corruption. This paper describes a versioning file system that combines log-structuring with novel metadata journal...
متن کاملMEDICAL IMAGE COMPRESSION: A REVIEW
Within recent years the use of medical images for diagnosis purposes has become necessity. The limitation in transmission and storage space also growing size of medical images has necessitated the need for efficient method, then image Compression is required as an efficient way to reduces irrelevant and redundancy of the image data in order to be able to store or transmits data. It also reduces...
متن کامل